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(54) image processing apparatus, image processing method, and computer program for 
removing low-frequency noise in image data 



(57) This invention provides an image processing 
apparatus, image processing method, and computer 
program, which can visually remove low-frequency 
noise contained in image data. Image data containing 
low-frequency noise is input from an Input tenntnal 
(201). A window unit (202) designates a window made 
up of a pixel of interest, and its surrounding pixels. A 



pixel selector (204) selects a selected pixel to be com- 
pared with the pixel of interest from the window, and a 
pixel value determination unit (206) determines a new 
pixel value of the pixel of interest on the basis of the 
pixel values of the selected pixel and pixel of interest. 
New Image data is generated by substituting the pixel 
value of the pixel of interest by the new pixel value. 
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Description 

FIELD OF THE INVENTION 

[0001] The present invention relates to an Image 
processing apparatus and image processing method, 
and a computer program, which can visually remove 
noise components from image data on which no Ise com- 
ponents that are not contained in the original signal com- 
ponents are superposed. 

BACKGROUND OF THE INVENTION 

[0002] Conventionally, a technique for removing 
noise components from a digital image on which noise 
components that are not contained in the original signal 
components are superposed has been studied. The 
characteristics of noise to be removed are diverse de- 
pending on their generation causes, and noise removal 
methods suited to those characteristics have been pro- 
posed. 

[0003] For example, when an image input device such 
as a digital camera, image scanner, or the like Is as- 
sumed, noise components are roughly categorized into 
noise which depends on the input device characteristics 
of a solid-state image sensing element or the like and 
input conditions such as an image sensing mode, 
scene, or the like, and has already been superposed on 
a photoelectricatly converted analog original signal, and 
noise which is superposed via various digital signal 
processes after the analog signal is converted into a dig- 
ital signal via an A/D converter. 

[0004] As an example of the former (noise super- 
posed on an analog signal), impulse noise that gener- 
ates an isolated value to have no correlation with sur- 
rounding image signal values, noise resulting from a 
dark current of the solid-state image sensing element, 
and the like are known. As an example of the latter 
(noise superposed during a digital signal process), 
noise components are amplified simultaneously with 
signal components when a specific density, color, and 
the like are emphasized in various correction processes 
such as gam ma correction, gain correction for improving 
the sensitivity, and the like, thus Increasing the noise lev- 
el. 

[0005] As an example of deterioration of an image due 
to noise superposed in a digital signal process, since an 
encoding process using a JPEG algorithm extracts a 
plurality of blocks from two-dimensional (2D) image in- 
formation, and executes orthogonal transfonnation and 
quantization for respective blocks, a decoded image 
suffers block distortion that generates steps at the 
boundaries of blocks. 

[0006] In addition to various kinds of noise mentioned 
above, a cause that especially Impairs the image quality 
is noise (to be referred to as "low-frequency noise" here- 
inafter) which is generated in a low -frequency range and 
is conspicuously observed in an image sensed by a 
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digital camera orthe like. This low-frequency noise often 
results from the sensitivity of a CCD or CMOS sensor 
as a solid-state Image sensing element. In an image 
sensing scene such as a dark scene with a low signal 
5 level, a shadowy scene, or the like, low-frequency noise 
is often emphasized due to gain conrection that raises 
signal components irrespective of poor S/N ratio. 
[0007] Furthemnore, the element sensitivity of the sol- 
id-state image sensing element depends on Its chip ar- 
10 ea. Hence, in a digital camera which has a large number 
of pixels within a small area, the amount of light per unit 
pixel consequently decreases, and the sensitivity low- 
ers, thus producing low-frequency noise. For example, 
low-frequency noise Is often visually recognized as 
15 pseudo mottled texture across several to ten-odd pixels 
on a portion such as a sheet of blue sky orthe like whteh 
scarcely has any change in density (to be referred to as 
a "^flat portion" hereinafter). Some digital cameras often 
produce false colors. 

[0008] As a conventionally proposed noise removal 
method, a method using a median filter and a method 
using a low-pass filter (to be abbreviated as "LPP here- 
inafter) that passes only a low-frequency range have 
prevailed. 

[0009] In the method of using a median filter, a pixel 
value which assumes a central value (to be referred to 
as "median" hereinafter) is extracted from a region (to 
be referred to as "window" hereinafter) which includes 
a pixel of interest and its surrounding pixels, and the ex- 
tracted median replaces the pixel value of interest. For 
example, many methods using a median filter such as 
Japanese Patent Laid-open No. 4-235472 and the like 
have been proposed. Especially, when the pixel of inter- 
est is impulse noise or random noise, the median filter 
replaces the pixel value of interest as an isolated value 
with low correlation with surrounding pixels by the me- 
dian with high correlation with surrounding pixels, there- 
by removing the isolated value in original image infor- 
mation. 

[0010] On the other hand, in the method using an LPF, 
the average value of a plurality of pixels around a pixel 
of interest to have the pixel of interest as the center is 
calculated, and replaces the pixel value of interest. Fig. 
19 shows an example of a conventional LPF which cal- 
culates the average value of a plurality of pixels around 
a pixel of interest to have the pixel of interest as the cent- 
er. This method is mainly effective for block distortion 
mentioned above. That is, since block distortion is noise 
that generates block-like steps different from signal 
components on a portion which is originally a flat portion, 
the steps can become hardly visible by moderating the 
gradients of the steps. 

[0011] The aforementioned two noise removal meth- 
ods can effectively woric locally, but have adverse effects 
(blur of an edge portion and the like) . Hence, many mod- 
ifications of these methods have been proposed. For ex- 
ample, Japanese Patent Laid-Open No. 2001-245179 
discloses a method of making product sum calculations 
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by selecting only surrounding pixels which are approxi- 
mate to the pixel value of interest upon calculating the 
average value, so as not to blur an image due to a noise 
removal filter process. 

[0012] In addition to the above two methods, i.e., the 
method of using a median filter and the method using 
an LPF» many other methods that pertain to noise and 
distortion removal have been proposed. For example, 
Japanese Patent Lald-Open No. 8-56357 discloses a 
method of replacing signal values between pixels which 
are located on the two sides of the block boundary, so 
as to remove block distortion. Furthermore, Japanese 
Patent Laid-Open No. 10-98722 discloses a method of 
adding a predetemiined pattern selected from a plurality 
of patterns based on a random number to pixel signal 
levels around the block boundary. 
[0013] i\^oreover, Japanese Patent Laid-Open No. 
7-75103 discloses a method of removing block distor- 
tion produced upon encoding by adding an error to the 
level value of a specific pixel of interest having the block 
boundary as the center. In addition, Japanese Patent 
Lald-Open No. 4-239886 discloses a method of remov- 
ing noise by detecting maximum and minimum values 
from pixels which neighbor the pixel of interest, and se- 
lecting one of the maximum value, minimum value, and 
the pixel value of interest using, as a control signal, the 
determination result indicating whether or not noise is 
contained, so as to remove white and black points hav- 
ing isolated values. 

[001 4] However, none of these conventional methods 
can exhibit a perfect noise removal effect of the afore- 
mentioned low-frequency noise-. For example, the meth- 
od using a median filter has only an effect of deleting an 
isolated value which has low correlation with surround- 
ing values, and the method using an LPF is effective 
only for high-frequency noise or white noise with high 
randomness by cutting off a high-frequency range. 
Hence, these methods are not effective for low-frequen- 
cy noise, and the low-frequency noise remains unre- 
moved. 

[0015] The method described in Japanese Patent 
Laid-Open No. 8-56357 or the like, which aims at remov- 
ing block distortion, can effectively reduce steps by a 
method based on random number addition, a method of 
replacing pixel values between blocks or the like, as long 
as the block boundary is known, since block distortion 
to be removed is a high-frequency component generat- 
ed as a rectangular step. However, the low-frequency 
noise to be removed is connectivity noise, i.e., pixel val- 
ues which have less changes successively appear 
across abroad range from several to ten-odd pixels, and 
the aforementioned technique that reduces block distor- 
tion cannot be directly applied. Of course, the genera- 
tion position of noise is not known unlike the block 
boundaries upon block encoding. 
[0016] On the other hand, the method based on ran- 
dom number addition applies a pixel value which is not 
present in surrounding pixels. Hence, especially in a 



color image, when random numbers are added to re- 
specth/e color components obtained by color separa- 
tion, a new color which is not present in surrounding pix- 
els is generated, and deterioration of image quality such 

5 as generation of false colors or the like occurs. 

[0017] Japanese Patent Laid-Open No. 7-20321 0 dis- 
closes an invention that reduces the signal strength of 
a spedfte frequency, although its object Is different from 
noise removal of the present Invention. In a system 

10 which receives a halftone dot document and executes 
dithering of a pseudo halftone process upon output, 
moir6 is generated due to interference of the frequency 
of the input halftone dots and that of dithering. The in- 
vention described in Japanese Patent Laid-Open No. 

15 7-203210 is a moir6 removal method that removes the 
frequency of the input halftone dots to prevent genera- 
tion of molr6. 

[0018] That is, this moir6 removal method replaces 
the pixel value of interest by a pixel value which is lo- 
20 cated ahead of the pixel of interest by a distance corre- 
sponding to a predetermined number of pixels on a line, 
since it Is effective to disturb certain regularity to remove 
the frequency of halftone dots. The above invention dis- 
closes cases wherein the predetermined number of pix- 
25 els is fixed and is randomly selected. 

[0019] However, since this moir6 removal method 
aims at disturbing a specific period corresponding to a 
peak, it is not completely effective for low-frequency 
noise, which is generated in a broad low-frequency 
30 range. Since this method replaces pixel values, density 
preservation is guaranteed, but that method is merely a 
process of changing the selected pixel value, i.e.. spa- 
tially shifting pixel phases. Furthermore, since a change 
in selected pixel value corresponds to cyclic filter char- 
ts acteristics, an impulse response becomes infinity. Even 
when the predetermined number of pixels as the dis- 
tance between pixels to be replaced is randomly select- 
ed, since sampled pixels are replaced in turn, a moird 
period is merely displaced by shifting peak phases of 
40 halftone dots, which are generated at specific periods. 
[0020] As described above, none of the aforemen- 
tioned prior arts can effectively remove low-frequency 
noise components contained in image data. 

45 SUMMARY OF THE INVENTION 

[0021] The present invention has been proposed to 
solve the conventional problems, and has as one con- 
cern to provide an image processing apparatus and im- 
50 age processing method, and a computer program, 
which can visually remove low-frequency noise con- 
tained in image data. 

[0022] In one aspect, an Image processing apparatus 
according to the present invention is characterized by 
55 comprising input means for inputting Image data con- 
taining low-frequency noise, designation means for des- 
ignating a region made up of a predetermined pixel and 
surrounding pixels of the predetermined pixel in the Im- 
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age data, selection means for selecting a comparison 
pixel to be compared with the predetermined pixel from 
the region, determination means for determining a new 
pixel value of the predetennined pixel on the basis of 
pixel values of the comparison pixel and the predeter- 
mined pixel, and substitution means for generating new 
Image data by substituting the pixel value of the prede- 
tenmlned pixel by the new pixel value. 
[0023] The selection means may select the compari- 
son pixel from the region using a random number and 
may use a random number, which is generated on the 
basis of a unifonn probability distribution, which may be 
generated on the basis of a generation probability dis- 
tribution depending on a distance from the predeter- 
mined pixel, and which has a higher generation proba- 
bility with increasing distance from the predetermined 
pixel. 

[0024] According to a feature of the present invention 
the selection means may select the comparison pixel 
from the region on the basis of a predetermined regu- 
larity. 

[0025] The predetemiined regularity may vary a rela- 
tive position from the predetennined pixel for each pre- 
determined pixel. 

[0026] The predetennined regularity may determine 
a relative position from the predetermined pixel on the 
basis of an absolute coordinate position of the predeter- 
mined pixel. 

[0027] A feature of the present invention is that the 
detennination means determines the new pixel value of 
the predetemiined pixel on the basis of a difference be- 
tween the pixel values of the comparison pixel and the 
predetermined pixel. 

[0028] Additionally the present invention determina- 
tion means may determine the pixel value of the com- 
parison pixel as the new pixel value of the predeter- 
mined pixel when the difference if not more than a pre- 
determined value. 

[0029] A feature of the invention in that the that the 
detennination means detennines a value obtained by 
adding or subtracting a predetennined value to or from 
the pixel value of the predetermined pixel as the hew 
pixel value of the predetennined pixel. 
[0030] Apparatus according to the present invention 
may further comprise approximate color generation 
means for generating an approximate color which is ap- 
proximate to the pixel value of the comparison pixel, and 
in that the detennination means uses the approximate 
color as the new pixel value of the predetennined pixel. 
[0031] The approximate colour generation means 
may generate an approximate colour, which is appropri- 
ate to at least one of a plurality of colour components 
within a predetermined range. 

[0032] Additionally the detennination means may de- 
termine new pixel values of the predetennined pixel us- 
ing the approximate color which is generated by approx- 
imation within the predetermined range for at least one 
of a plurality of color components, and using pixel values 



of the comparison pixel for the remaining color compo- 
nents. 

[0033] Furthermore the detennination means may 
have two threshold values, determines the pixel value 

5 of the predetermined pixel as the new pixel value when 
the difference Is smaller than a first threshold value, and 
determines the approximate color as the pixel value of 
the predetermined pixel when the difference for at least 
one of a plurality of color components is not less than 

10 the first threshold value and is smaller than a second 
threshold value. 

[0034] Image processing apparatus according to the 
present invention may comprise input means for input- 
ting image data containing low-frequency noise, desig- 
ns nation means for designating a region made up of a pre- 
determined pixel and surrounding pixels of the prede- 
termined pixel in the Image data, selection means for 
selecting a comparison pixel to be compared with the 
predetermined pixel from the region, and determination 
20 means for determining a new pixel value of the prede- 
termined pixel by a product sum calculation of pixel val- 
ues of the comparison pixel and the predetermined pix- 
el. 

[0035] The determination means may determine the 
25 new pixel value of the predetermined pixel by interpola- 
tion of the comparison pixel and the predetermined pix- 
el. 

[0036] Additionally the determination means may de- 
termine the new pixel value of the predetermined pixel 
30 by extrapolation of the comparison pixel and the prede- 
termined pixel. 

[0037] A weighting coefficient in the product sum cal- 
culation may be set on the basis of a difference between 
the pixel values of the comparison pixel and the prede- 
35 termined pixel, calculation may use different weighting 
coefficients in 

[0038] According to another feature the determination 
means may compare if difference for all of a plurality of 
color components are not more than a predetennined 
40 value 

[0039] In a still further feature the selection means 
may select a plurality of comparison pixels from the re- 
gion, and the determination means determines the new 
pixel value of the predetermined pixel using the plurality 

45 of selected comparison pixels. 

[0040] Apparatus according to the present invention 
may further comprise pseudo halftone means for exe- 
cuting a pseudo halftone process of the generated new 
image data using error diffusion. 

50 [0041] According to an aspect of the present inven- 
tion, an image processing apparatus for visually reduc- 
ing noise components contained in a low-frequency 
range of Image data, Is characterized by comprising cor- 
relation reduction means for reducing correlations be- 

55 tween a predetermined pixel and surrounding pixels of 
the predetermined pixel in the image data, signal 
strength control means for controlling decreased signal 
strengths of low-frequency components upon reducing 
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the correlations, and white noise conversion means for 
converting the decreased signal strengths into white 
noise components. 

[0042] According to another aspect, an image 
processing apparatus for visually reducing noise com- 
ponents contained in a low-frequency range of Image 
data, is characterized by comprising congelation reduc- 
tion means for reducing correlations between a prede- 
termined pixel and surrounding pixels of the predeter- 
mined pixel in the image data, signal strength control 
means for controlling decreased signal strengths of low- 
frequency components upon reducing the correlations, 
broad-band noise conversion means for converting the 
decreased signal strengths into broad-band noise com- 
ponents, and band width control means for controlling 
a band width of the broad-band noise conversion 
means. 

[0043] Other features and advantages of the present 
invention will be apparent from the following description 
taken in conjunction with the accompanying drawings, 
in which like reference characters designate the same 
or similar parts throughout the figures thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0044] The accompanying drawings, which are Incor- 
porated in and constitute a part of the specification, il- 
lustrate embodiments of the invention and, together with 
the description, serve to explain the principles of the in- 
vention. 

Fig. 1 Is a block diagram showing the arrangement 
of an image processing apparatus which is imple- 
mented by applying a low-frequency noise function 
according to the present invention to a printer driver 
that generates print information to be output to a 
printer engine on a computer; 
Fig. 2A is a block diagram showing the detailed ar- 
rangement of a noise removal module 101 shown 
in Fig. 1; 

Fig. 2B is a block diagram showing a hardware ar- 
rangement that implements the noise removal mod- 
ule 101 shown in Fig. 1 as a noise removal device; 
Fig. 3 is a flow chart for explaining the operation se- 
quence of the noise removal module 101; 
Fig. 4 shows a model of the relationship between 
the spatial distance from a pixel of interest, and a 
corresponding autocorrelation function; 
Fig. 5 shows the frequency characteristics obtained 
by clipping a local region where low-frequency 
noise Is generated from arbitrary image information, 
and transforming the clipped region using DFT (dis- 
crete Fourier transformation); 
Fig. 6 shows the frequency characteristics after the 
region shown in Fig. 5 has undergone a noise re- 
moval process using the operation sequence 
shown in the flow chart of Fig. 3; 
Figs. 7A and 78 show models of low-frequency 



noise before and after the noise removal process 
on a real space; 

Fig. 8 shows the frequency characteristics after the 
region shown in Fig. 5 has undergone the noise re- 

5 moval process using the operation sequence 
shown in the flow chart of Fig. 3. and also a pseudo 
halftone process based on error diffusion; 
Figs. 9A and 98 show models of the frequency char- 
acteristics of flat and non-fiat portions; 

10 Figs. 10A and 108 show models of the frequency 
characteristics after the portions shown in Figs. 9A 
and 98 have undergone the noise removal process 
using the operation sequence shown in the flow 
chart of Fig. 3; 

IS Fig. 11 is a flow chart for explaining the operation 
sequence of a noise removal module according to 
the second embodiment of the present invention; 
Figs. 12A, 128, 120, and 1 2D are views for explain- 
ing examples of categories of comparison in the se- 

20 quence shown in the flow chart of Fig. 11; 

Figs. 1 3A and 1 38 are views for explaining a color 
change vector between two colors of the pixel of In- 
terest and selected pixel, or of the pixel of interest 
and replace pixel; 

25 Fig. 14 is a flow chart for explaining the operation 
sequence of a noise removal module according to 
the third embodiment of the present invention; 
Fig. 15 is a flow chart for explaining the operation 
sequence of a noise removal module according to 

30 the fourth embodiment of the present Invention; 

Fig. 1 6 shows the concept of extrapolation done in 
the fourth embodiment; 

Fig. 17 is a flow chart for explaining the operation 
sequence of a noise removal module according to 
35 the fifth embodiment of the present Invention; 

Figs. 1 BA and 1 88 are views for explaining an out- 
line of probability distribution correction done in step 
SI 704; and 

Fig. 1 9 shows an example of a conventional LPF 
40 used to calculate the average value of a pixel of in- 
terest and its surrounding pixels to have the pixel of 
interest as the center. 

DETAILED DESCRIPTION OF THE PREFERRED 
45 EMBODIMENTS 

[0045] Preferred embodiments of the present inven- 
tion will now be described in detail in accordance with 
the accompanying drawings. 

50 

<First Embodiment> 

[0046] An image processing apparatus which com- 
prises a low-frequency noise removal function accord- 
5S ing to the first embodiment of the present invention, and 
generates print Information to be output to a printer en- 
gine will be described below with reference to the ac- 
companying drawings. 
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[0047] Note that the low-frequency noise removal 
function according to the present invention can be ap- 
plied to various fornis as a function in an image input 
device such as a digital camera, image scanner, or the 
tike, that in an image output device such as an ink-jet 
printer, sublimatic printer, laser printer, or the like, orthat 
in a device driver or application software on a computer 
required to control these input/output devtees. 
[0048] Fig. 1 Is a block diagram showing the arrange- 
ment of an image processing apparatus which is imple- 
mented by applying a low-frequency noise function ac- 
cording to the present invention to a printer driver that 
generates print information to be output to a printer en- 
gine on a computer. As shown in Fig. 1. the Image 
processing apparatus according to the present inven- 
tion comprises an Input teniDlnal 100. noise removal 
module 101 , color conversion module 1 02, pseudo half- 
tone module 103, and output tenninal 104. 
[0049] Referring to Fig. 1 , the input terminal 1 00 is an 
image information input module for inputting color Image 
Infomiation from application software or the like. Color 
image infonmation sensed by a digital camera or the like 
is normally encoded to a standard file format such as 
JPEG or the like before it is transmitted. Hence, in this 
embodiment, encoded color image Information input to 
the input terminal 100 is output to the noise removal 
module 101 after it is rasterizedto decoded raster data. 
Note that attribute information such as the model name 
of a digital camera, image sensing scene, Image sens- 
ing mode, or the like is often output together with color 
image information. 

[0050] The noise removal module 101 executes a 

noise removal process of color image information made 
up of color components R, G, and B. Note that the de- 
tailed arrangement and operation of the noise removal 
module 101 will be explained later. 
[0051] The color conversion module 1 02 converts the 
noise-removed RGB image information output from the 
noise removal module 101 into information of color 
agents used upon recording by a printer. Note that four 
components C (cyan), M (magenta), Y (yellow), and K 
(black) are basically used as color agent components. 
Some ink-jet printers use inks with lower dye densities 
in addition to the above color agent components. 
[0052] The pseudo halftone module 103 converts 
color image information, which has been separated into 
color agent components detemnined by the color con- 
version module 102, into quantization levels smaller in 
number than the number of gray levels of the color im- 
age information, and expresses grayscale as an area 
by quantized values of a plurality of pixels. Assume that 
this embodiments adopts error diffusion that diffuses a 
quantization error of a pixel of Interest to sun^ounding 
pixels as the pseudo halftone process. Note that a de- 
tailed description of error diffusion will be omitted since 
it is a state-of-the-art technique. Because an error diffu- 
sion is a publicly known processing, the detailed expla- 
nation is omitted. 



[0053] The output terminal 104 Is an output module 
which transmits quantized infomnation for respective 
color agent components generated by the pseudo half- 
tone module 103 to a printer engine (not shown). That 
5 is, the image processing apparatus according to the 
present invention is characterized by comprising the 
pseudo halftone module 103 which converts generated 
new Image data into pseudo halftone data using error 
diffusion. 

10 [0054] Note that the arrangement of the image 
processing apparatus shown in Fig. 1 is used when color 
Image infomnation input from the input temninal 100 is 
output to a printer engine without changing the resolu- 
tion. Aiso, in order to eliminate the difference between 

15 the resolutions of the printer engine and input color im- 
age infomfiation, a resolution conversion unit that makes 
resolution conversion by an Interpolation process may 
be inserted between the noise removal module 101 and 
color conversion module 102. 

20 [0055] Fig. 2A is a block diagram showing the detailed 
arrangement of the noise removal module 101 shown in 
Fig. 1 . As shown in Fig. 2A, the noise removal module 
101 according to this embodiment comprises an Input 
terminal 201 , line buffer 202, window unit 203, pixel se- 

25 lector 204, random number generator 205, pixel value 
detemiination unit 206, and output tenminal 207. 
[0056] Refen-ing to Fig. 2 A, the input temninal 201 re- 
ceives RGB color image information output from the in- 
put terminal 100 in Fig. 1. The line buffer 202 stores/ 

30 holds the color image infomnation input to the input ter- 
minal 201 for each line. The window unit 203 can fonn 
a 2D reference pixel window having a pixel of interest 
as the center since it has line buffers 202 for a plurality 
of lines. 

35 [0057] The pixel selector204 selects an arbitrary pixel 
from those which form the window on the basis of a 
pseudo random number generated by the random 
number generator 205. The pixel value determination 
unit 206 determines a new pixel value of the pixel of in- 

40 terest on the basis of the pixel of interest of the window 
unit 203. and the selected pixel selected by the pixel 
value selector 204. 

[0058] Fig. 2B shows the hardware arrangement up- 
on implementing the noise removal module with the 
"^5 above arrangement as a noise removal device. A noise 
removal device 210 comprises a GPU 211, ROM 212, 
and RAM 21 3. In the noise removal device 210, the CPU 
211 controls the operations of the respective units of the 
aforementioned noise removal module 101 in accord- 
so ance with a control program held by the ROM 212. The 
RAM 213 is used as a work area of the CPU 211 . 
[0059] The operation of the noise removal module 
1 01 with the above arrangement will be described be- 
low. Fig. 3 Is a flow chart for explaining the operation 
55 sequence of the noise removal module 101. Assume 
that color image information input to the noise removal 
module 101 is an image having a size of the number of 
horizontal pixels = WIDTH x the number of vertical plx- 
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els - HEIGHT. 

[0060] The noise removal module 1 01 Is initialized. In 
practice, the CPU 21 1 resets variable 1 indicating a ver- 
tical processing address to zero (step S301). Likewise, 
the CPU 211 resets variable j indicating a horizontal 
processing address to zero (step S302). 
[0061 ] The random number generator 205 generates 
a random number (step S303). The pixel selector 204 
determines the values of horizontal and vertical relative 
positions a and b from the pixel of interest on the basis 
of the random number generated by the random number 
generator 205 (step S304). Upon detemnining horizontal 
and vertical relative positions a and b, two random num- 
bers maybe independently generated, or two variables 
may be calculated by a random number which is gener- 
ated once. A random number generation algorithm is not 
particularly limited, but is assumed to be probabilistically 
uniform. That is, the noise removal module 101 accord- 
ing to the present invention is characterized by selecting 
a selected pixel from the window using a random 
number. Also, the present embodiment is characterized 
in that the pixel selector 204 uses a random number 
generated based on a uniform probability distribution. 
[0062] Note that the values of horizontal and vertical 
relative positions a and b are selected not to exceed the 
window size. For example, If the window size is 9 x 9 
pixels having the pixel of interest as the center, values 
a and b are set using a remainder calculation based on 
the generated random number to fall within the ranges 
-4 < a < 4 and -4 < b < 4. 

[0063] Using values a and b determined in step S304, 
the pixel selector 204 malces comparison (step S305) to 
see whether or not: 

llr(i, j) - lr(i+a, j+b)l <Thr 

and 

Hg(i. j)-lg(i+a, j+b)l <Thg 

and 

llb(i, j) - lb(l+a, j+b)l <Thb 

where Ir (i, j) is the pixel value of the R component of 
the pixel of interest located at a coordinate position (i, 
j), lg(i, j) is the pixel value of the G component, and lb(i, 
j) is the pixel value of the B component. Also, Thr, Thg, 
and Thb are respectively predetermined R, G, and B 
threshold values. Furthermore, Ixl is the absolute value 
of X. 

[0064] That is, it is determined in step S305 whether 
or not the absolute values of the differences between 
three, R, G, and B component values of a selected pixel 
arbitrarily selected from the window, and those of the 



pixel of interest of become smaller than the predeter- 
mined threshold values. 

[0065] If it Is detemnined as a result of comparison that 
all the three, R, G, and 8 component values become 

5 smaller than the predetermined threshold values (Yes 
in step S305), the pixel selector 204 substitutes the se- 
lected pixel values as new values of the pixel of interest 
(step S306). Assume that Fr, Fg, and Fb represent new 
R, G, and B component values of the pixel of interest 

10 [0066] On the other hand, If not ali the three. R, G, 
and B component values become smaller than the pre- 
detennined threshold values (No In step S305), the pixel 
selector 204 uses the old values of the pixel of interest 
as new values (step S307). Hence, no substitution of 

IS the values of the pixel of interest is made In this case. 
That Is, the noise removal module 101 in this embodi- 
ment is 

characterized in that the pixel value determination unit 
206 determines a new pixel value of a pixel of interest 

20 on the basis of the difference between the pixel values 
of a selected pixel and the pixel of interest. Also, the 
present embodiment is characterised In that when the 
difference is equal to or smaller than a predetermined 
value, the pixel value detenmination unit 206 determines 

25 the selected pixel value as the pixel value of the pixel of 
interest. 

[0067] The horizontal address is counted up for one 
pixel (step S308). Then, a series of processes are re- 
peated while scanning the pixel of interest one by one 

30 until the horizontal pixel position reaches the (WIDTH) 
-th pixel (step S309). Likewise, the vertical address is 
counted up for one pixel (step S310). Then, a series of 
processes are repeated while scanning the pixel of In- 
terest one by one until the vertical pixel position reaches 

35 the (HEIGHT)-th pixel (step S311). Upon completion of 
scans for all pixels, the noise removal process ends. 
[0068] The principle of noise removal according to this 
embodiment will be described below. 
[0069] Fig. 4 shows a model of the relationship be- 

40 tween the spatial distance from the pixel of interest, and 
corresponding autocorrelation function. Fig. 4 shows 
the graph of the relationship between the autocorrela- 
tion function and inter-pixel distance in an upper portion, 
and the state of a pixel sequence in a lower portion. Note 

45 that Fig. 4 shows only a linear pixel sequence for the 
sake of simplicity. 

[0070] As is known, the autocorrelation function ex- 
ponentially decreases as the relative position with re- 
spect to the pixel of interest increases. For example, pix- 

50 els at positions A and B in Fig. 4 have different autocor- 
relation functions with the pixel of interest. That is, since 
pixels in the window have different correlation functions 
depending on the distances from the pixel of interest, 
substituting the pixel value of Interest amounts to select- 

55 ing a pixel with ariaitrary correlation from a set of different 
correlation function values. Therefore, when pixels are 
selected in a uniform probability distribution irrespective 
of correlation values, nearly random correlations are ob- 
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tained after substitution, thus implementing conversion 
into white noise. 

[0071 ] Fig. 5 shows the frequency characteristics ob- 
tained by clipping a local region where low-frequency 
noise is generated from arbitrary image information, and 
converting that region using D FT (discrete Fourier trans- 
formation). In Fig. 5, the origin represents a DC compo- 
nent, the ordinate plots the spatial frequency in the ver- 
tical direction, and the abscissa plots the spatial fre- 
quency In the horizontal direction. Higher-frequency 
components appear as they are farther away from the 
origin in both the horizontal and vertical directions. 
[0072] In Fig. 5, white dots represent signal strengths 
(power spectrum) in predetermined frequency compo- 
nents, and more white dots are plotted with increasing 
signal strength. Note that the clipped region shown in 
Fig. 5 corresponds to a flat portion, and has a small 
number of AC signal components otherthan noise com- 
ponents. More specifically, frequency components with 
high strength In the low-frequency range in Fig. 5 are 
generated by noise and, hence, generation of noise 
stands out very much and deteriorates the image qual- 
ity. 

[0073] Fig. 6 shows the frequency characteristics af- 
ter the region shown in Fig. 5 has undergone the noise 
removal process using the operation sequence shown 
in the flow chart in Fig. 3. As can be seen from Fig. 6, 
low-frequency signal components which are generated 
on the central portion of Fig. 5 are reduced, and white 
noise components which spread over the respective fre- 
quency ranges are generated. 

[0074] Figs. 7A and 7B show models of low-frequency 
noise components before and after the noise removal 
process on a real space. In Figs. 7A and 73, one box 
represents one pixel, which Is expressed by two gray 
levels for the sake of simplicity. At first, assume that low- 
frequency noise is visually recognized as a cluster with 
connectivity, as shown in Fig. 7A. By selecting pixels 
from positions inside/outside the cluster with connectiv- 
ity, and substituting them, connectivity is lost, as shown 
in Fig. 78. That is, noise visually recognized as a "con- 
tinenf-like shape is broken up into "island"-like compo- 
nents and, as a result, the former "continent"-like noise 
disappears. Therefore, white noise expressed on the 
frequency characteristic graph in Fig. 6 can be consid- 
ered as a result of decomposition of "continenf-like 
noise into "island"-like components of various sizes. 
[0075] Fig. 8 shows the frequency characteristics af- 
ter the region shown in Fig. 5 has undergone the noise 
removal process using the operation sequence shown 
in the flow chart of Fig. 3, and also a pseudo halftone 
process based on error diffusion. As is known, error dif- 
fusion exhibits the characteristics of a broad-band high- 
pass filter (HPF). That Is, as can be seen from Fig. 8, 
white noise explained using Figs. 7A and 78 become 
hardly visible in the presence of high-frequency noise 
generated by error diffusion. Furthermore, since the 
(VITF (IVlodulation Transfer Function) of the human visual 



characteristics is attenuated with increasing frequency, 
white noise generated by noise removal can hardly be 
recognized on a print, which is output to a printer engine. 
[0076] Adverse effects upon converting iow-frequen- 

5 cy components into white noise will be explained below. 
[0077] Figs. 9A and 98 show models of the frequency 
characteristics of flat and non-flat portions. Fig. 9A 
shows a model of the frequency characteristtes of a 
completely flat portion where pixel values change less. 

10 Fig. 9B shows a model of the frequency characteristics 
of a portion (non-fiat portion) where pixel values change 
slowly and do not form a steep edge. Both Figs. 9A and 
98 are expressed lineariy for the sake of simplicity. In 
Figs. 9A and 98, the abscissa plots the spatial frequen- 

is cy, and the ordinate plots the signal strength. Also, the 
origin Indicates a DC component Furthermore, assume 
that low-frequency noise is generated In both the re- 
gions of Figs. 9A and 98. 

[0078] In this case, in the example shown in Fig. 9 A, 

20 signal components other than the DC component are 
small, and most AC signal components are generated 
due to low-frequency noise. The example shown in Fig. 
9B shows the total signal strength of signal components 
of the non-flat portion and low-frequency noise, and the 

25 signal strength in Fig. 98 is overwhelmingly higher than 
the low-frequency noise strength shown in Fig. 9A. That 
is, assuming that the strength of low-frequency noise is 
constant, the S/N ratio as a relative ratio between the 
signal strength and noise strength becomes higher in a 

30 region where a change in pixel value is large, while the 
S/N ratio becomes lower in a region where the change 
width of pixel values is small and noise is dominant. 
[0079] Figs. 10A and 108 show models of the fre- 
quency characteristics after the portions shown in Figs. 

35 9A and 98 have undergone the noise removal process 
using the operation sequence shown in the flow chart of 
Fig. 3. As can be seen from comparison with Fig. 9A. in 
Fig. 10A, "mountain" of the low-frequency power 
strength breaks up, and low-frequency noise can be 

40 converted into white noise components which spread up 
to the high-frequency range. However, the sum total of 
the DC and AC signal strengths of respective frequen- 
cies remains the same. 

[0080] Upon comparison of Fig. 1 08 with Fig. 98, the 
45 degree that "mountain" of the low-frequency power 
strength breaks up Is relatively small unlilce in Fig. 10A. 
Note that the degree that "mountain" of the low-frequen- 
cy power strength breaks up depends on the relative ra- 
tio between the original low-frequency signal strength 
50 and a signal strength converted into white noise by the 
noise removal process. That is, even when a region 
where signal components are large undergoes the noise 
removal process using the operation sequence shown 
in the flow chart of Fig. 3, only noise components super- 
55 posed on the signal components can be effectively con- 
verted without any adverse Influence such as a large 
change in original signal component. 
[0081] As described in the operation sequence shown 
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In the flow chart of Fig. 3, when the difference between 
the values of the selected pixel and pixel of Interest Is 
large, no substitution is executed (step S307). In other 
words, by setting the threshold value used to determine 
whether or not to substitute, a signal strength to be con- 
verted into white noise can be controlled. Assume that 
the threshold value Is constant irrespective of signal 
component values. In this case, in a region where the 
change amount Is large, since the difference between 
the values of the pixel of interest and selected pixel in- 
creases, such large differences appear in high probabil- 
ity, and the number of pixels which undergo a substitu- 
tion process probabilistically decreases. 
[0082] As can be seen from this, the adverse influ- 
ence of the noise removal process in a region where the 
change amount is large Is small. On the other hand, In 
a region where the change amount is small, the number 
of pixels which undergo a substitution process probabi- 
iisticaliy increases. Hence, the noise removal process 
effectively works in this region. 

[0083] That is, a noise removal module 1 01 according 
to this embodiment Is characterized by comprising an 
Input terminal 201 for Inputting Image data containing 
noise-frequency noise, a window unit 203 for designat- 
ing a window made up of a pixel of interest and its sur- 
rounding pixels, a pixel selector 204 for selecting a se- 
lected pixel to be compared with the pixel of interest from 
the window, and a pixel value determination unit 206 for 
determining a new pixel value of the pixel of interest on 
the basis of the pixel value of the selected pixel and that 
of the pixel of interest, and In that new Image data is 
generated by substituting the pixel value of the pixel of 
interest by the new pixel value. 

[0084] The technique described above, converts 
noise present in a visually conspicuous frequency range 
into a hardly visible frequency range. As a simitar tech- 
nique, a spread spectrum technique in a communication 
method that spreads signal components in a specific fre- 
quency range to a broader frequency range by multiply- 
ing them by a pseudo random number sequence (PN 
sequence) is known. However, according to the present 
invention, low-frequency noise removal using a conver- 
sion technique with a higher degree of freedom can be 
implemented by a simpler arrangement. 
[0085] That is, since correlations are reduced using 
the aforementioned substitution process, some signal 
components in a low-frequency range can be reliably 
converted Into a high-frequency range. In this case, by 
optimizing the window size of selected pixels, which cor- 
respond to a partial set of autocorrelation functions, the 
band width of high-frequency broad-band noise to which 
the low-frequency noise strength Is converted can be 
controlled. By controlling the allowable amount of sub- 
stitution, the signal strength of noise to be converted 
from low-frequency signal components can be control- 
led. 



<Second Embodiment> 

[0086] Fig. 11 is a flow chart for explaining the oper- 
ation sequence of a noise removal module according to 

5 the second embodiment of the present invention. Note 
that the arrangements of the Image processing appara- 
tus and noise removal module according to the second 
embodiment are the same as those in the block dia- 
grams shown In Figs. 1 and 2. In the second embodl- 

10 ment, a color space on which the noise removal module 
101 executes noise removal Is a YCrCb color space as 
a luminance-color difference space in place of the RGB 
color space. 

[0087] Note that conversion from R, G, and B into Y, 

IS Cr, Cb is not the gist of the present invention, and a de- 
scription thereof will be omitted. Therefore, the RGB 
space may be converted Into the YCrCb space before 
input to the noise removal module 101 , or YUV signals 
as luminance and color difference signals decoded by 

20 the JPEG algorithm may be used intact. 

[0088] As shown in Fig. 1 1 , the noise removal module 
1 01 resets variable i indicating a vertical processing ad- 
dress to zero (step S1 101). Likewise, variable J indicat- 
ing a horizontal processing address is reset to zero (step 

25 S1 102). Furthermore, the random number generator 
205 generates a random number (step 81103). The pix- 
el selector 204 determines the values of horizontal and 
vertical relative positions a and b from the pixel of inter- 
est on the basis of the generated random number (step 

30 S1 104). 

[0089] Moreover, using the determine values a and b, 
the pixel selector 204 makes comparison (step S1 105) 
to see whether or not: 

lly(i.j)-ly(i+a,j+b)l<Thy1 

and 

40 

llcr(i, J) - lcr(i+a, j-»^)l < Thcr 

and 

45 

llcb(i, j) - Icb(i4-a, j+b)l < Thcb 

where ly(i, j) Is the pixel value of the Y component of the 
pixel of interest located at a coordinate position (t, j), Icr 
50 (i, j) is the pixel value of the Cr component, and Icb(i, j) 
is the pixel value of the Cb component. Also, Thyl , Thcr, 
and Thcb are respectively predetermined Y, Cr, and Cb 
threshold values. Furihemnore, Ixl is the absolute value 
of x. 

55 [0090] That Is, it Is determined In step S1 1 05 whether 

or not the absolute values of the differences between 
three, Y, Cr, and Cb component values of a selected pix- 
el arbitrarily selected from the window, and those of the 
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pixel of interest of become smaller than the predeter- 
mined threshold values. 

[0091 ] If it is determined as a result of comparison that 
all the three, Y, Cr, and Cb component values do not 
simultaneously become smaller than the predetenmined 
threshold values (No in step S1105)» the old values of 
the pixel of interest are used as new values of the pixel 
of Interest (step S1 106). That Is. no substitution of the 
values of the pixel of Interest is made in this case. As- 
sume that Fy, For, and Feb represent new Y, Cr, and Cb 
component values of the pixel of interest. 
[0092] On the other hand, if it rs determined that all 
the Y, Cr, and Cb component values become smaller 
than the predetemnined threshold values (Yes in step 
S1 1 05), the absolute value of the difference between the 
Y component values of the selected pixel and pixel of 
Interest Is compared with a threshold value Thy2, which 
is set for only the Y component (step SHOT). Note that 
Thy1 < Thy2. 

[0093] As a result, if the Y component Is smaller than 
the predetermined threshold value (Yes in step S1107), 
the Y, Cr, and Cb component values of the selected pixel 
are set as new values of the pixel of interest (step 

51 108) . On the other hand, if the Y component is not 
smaller than the predetermined threshold value (No in 
step 811 07), the Y component values of the selected 
pixel and pixel of Interest are compared (step S11 09). If 
the value of the pixel of interest is larger than that of the 
selected pixel as a result of comparison (Yes in step 

51 109) , the following conversion is made (step S1 110): 

Fy(l.j) = iy(i.j)-D, 



Fcr(i, j) = lcr(i+a, j+b), 



Fcb(i. j) = icb(i+a. j+b) (1) 

where D is a predetermined value, and D = Thy2 is often 
used. 

[0094] On the other hand, if the value of the selected 
pixel Is larger than that of the pixel of interest (No in step 
S1109), the following conversion is made (step S1 111): 

Fy(i, j) = ly(i.j)+D. 



Fcr(i, j) = icr(i+a, j+b), 



Fcb(i. j) = icb(i+a, j+b) (2). 

[0095] Subsequently, the horizontal address Is count- 
ed up for one pixel (step 811 12). 
[0096] That is, the noise removal module 101 accord- 



ing to this embodiment is characterised in that the pixel 
value detemnlnation unit 206 detemnlnes a new pixel val- 
ue of the pixel of interest by adding or subtracting a pre- 
detemrilned value to or from the pixel value of the pixel 

5 of interest. Also, the noise removal module 101 is char- 
acterized by further comprising an approximate color 
generation function of generating an approximate color, 
which is approximate to the pixel value of a selected pix- 
el, and In thatthe pixel value detenminatton unit 206 uses 

10 the generated approximate color as the new pixel value 
of the pixel of Interest. Furthermore, the noise removal 
module 101 Is characterized In that the approximate 
color generation function generates an approximate 
color which is approximate to at least one of a plurality 

15 of color components within a predetemnined range. 
[0097] Moreover, the noise removal module 101 ac- 
cording to the present invention is characterized In that 
the pixel value determination unit 206 determines new 
pixel values of the pixel of interest using an approximate 

20 color which Is generated by approximation within a pre- 
determined range for at least one of a plurality of color 
components, and using the pixel values of the selected 
pixel for the remaining color components. 
[0098] In addition, the noise removal module 101 is 

25 characterized in that the pixel value determination unit 
206 has two threshold values, sets a new pixel value as 
the pixel value of the pixel of interest when a difference 
is smaller than the first threshold value, and sets an ap- 
proximate color as the pixel value of the pixel of interest 

30 when a difference for at least one of a plurality of color 
components is equal to or larger than the first threshold 
value but is smaller than the second threshold value. 
[0099] Then, a series of processes are repeated while 
scanning the pixel of Interest one by one until the hori- 

35 zontal pixel position reaches the (WIDTH)-th pixel (step 
S1 11 3). Lil<ewise, the vertical address is counted up for 
one pixel (step S1 11 4). Then, a series of processes are 
repeated until the vertical pixel position reaches the 
(HEtGHT)-th pixel (step S1115). 

40 [01 00] Figs. 1 2A to 1 2D show examples of categories 
of comparison in the sequence shown in the flow chart 
of Fig. 11. Note that Figs. 12A to 12D explain the Y and 
Cr components in two dimensions for the sake of sim- 
plicity. Also, in Figs. 12A to 12D, variable D mentioned 

45 above is set to D = Thy2. 

[0101] Fig. 12A explains categories. In Fig. 12A, the 
ordinate plots the difference (iy(i, j) - iy(i+a, j+b)) be- 
tween the Y component values of the pixel of interest 
and selected pixel, and the abscissa plots the difference 

50 (icr(i, J) - lcr(i+a, j+b)) between the Cr component values 
of the pixel of interest and selected pixel. 
[0102] Note that the origin indicates a case wherein 
the values of the pixel of Interest and selected pixel are 
equal to each other, since the difference becomes zero. 

55 A rectangular region bounded by the bold line in Ftg. 
12A satisfies: 

Thyl < ly(i, j) - ly(i+a, j+b) < Thy1 and 
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Thcr < lcr(i, j) - lcr(i+a, j+b) < Thcr 

[01 03] Also, in Fig. 1 2 A. a iiatched rectangular region 

satisfies: 

- Thy2 < ly(i. j) - ly(i+a. j+b) < Thy2 and 

- Thcr < lcr(i, j) - lcr(l+a, j+b) < Thcr 

[0104] The operation sequence shown in the flow 
chart of Fig. 11 is roughly classified into three catego- 
ries. Hence, the hatched region is classified to category 
A, a region other than the region of category A in the 
bold rectangular region is classified to category B, and 
a region other than the bold rectangular region is clas- 
sified to category C in Fig. 12A. 
[0105] Fig. 1 2B shows an example when the selected 
pixel Is present within category A. In Fig. 128, the pixel 
of interest is indicated by a white dot, and the selected 
pixel is indicated by a black dot. With the operation se- 
quence shown in the flow chart of Fig. 11 , new values 
of the pixel of interest shift fronn the origin, and are sub- 
stituted by those of the selected pixel. 
[01 06] Fig. 1 2C shows an example when the selected 
pixel is present within category B. With the operation se- 
quence shown in the flow chart of Fig. 11 , a new value 
of the pixel of interest shifts from the origin, but does not 
exceed Thy2 Indicated by the broken line. Hence, only 
the Y component is clipped to the upper limit (Thy2). On 
the other hand, a new Cr component value Is substituted 
by that of the selected pixel. 

[01 07] Fig. 1 2D shows an example when the selected 
pixel is present within category C. In this case, with the 
operation sequence shown in the flow chart of Fig. 11, 
the pixel of interest does not shift from the origin. 
[01 08] This embodiment is particularly effective for lu- 
minance and color difference components. The human 
visual sensitivity level to a luminance component is 
largely different from those to color difference compo- 
nents; the luminance component is more sensitive to a 
change amount. As described above, the present em- 
bodiment breaks low-frequency noise and generates 
white noise instead, in this case, the strength level of a 
luminance perceived as a noise is largely different from 
those of color differences. 

[0109] More specifically, the white noise strength de- 
pends on a threshold value as an allowable value indi- 
cating whether or not to substitute. If a large allowable 
value is set for a luminance component, the white noise 
strength increases, and causes deterioration of the im- 
age quality. For this reason, the substitution ailowable 
amount of the luminance component must be set to low 
so that the image quality is free from deterioration. How- 
ever, when the operation sequence shown In the flow 
chart of Fig. 3 Is applied to the luminance-color differ- 
ence space, the luminance component of the selected 
pixei does not become equal to or lower than the low 
threshold value as the allowable amount of the lumi- 
nance component, and three components are often not 



sut>stituted consequently. 

[01 1 0] That is, the color difference components are to 

be positively substituted, but the number of pixels to be 
substituted probabilistically decreases due to the limited 

5 allowable amount of the luminance component. To avoid 
such problem, the luminance and color difference com- 
ponents can independently undergo selection and sub- 
stitution processes. However, In this case, a color whk^h 
Is not present in surrounding pixels Is generated as in 

10 random number addition described In the prior art, thus 
generating false colors. Hence, in this embodiment, the 
upper limit of a change amount upon substitution is set 
for the luminance component in addition to the threshold 
value as the substitution allowable amount. That is, 

15 since multi-level threshold value comparison processes 
are executed, the color difference components are pos- 
itively substituted, and the luminance component 
changes from the value of the pixel of interest. 
[0111] In the above method, however, since the val- 

20 ues of the selected pixel are not directly substituted, a 
false color which is not generated in surrounding pixels 
may be generated. However, compared to a case 
wherein the luminance and color difference components 
independently undergo selection and substitution proc- 

25 esses, a color change vector from the pixel of interest 
to a converted pixel value is approximate to that from 
the pixel of interest to the selected pixel, and deteriora- 
tion of the image quality can be suppressed. 
[0112] Figs. 13A and 13B are views for explaining a 

30 color change vector between two colors of the pixel of 
interest and selected pixel, or of the pixel of interest and 
replace pixel. Fig. 13A shows a color change vector be- 
tween two colors of the pixel of interest and selected 
pixel, and a color change vector between two colors of 

35 the pixel of interest and converted pixel. As in Figs. 1 2A 
to 12D, the pixel of interest is indicated by a white dot, 
and the selected pixei is indicated by a black dot. As 
shown in Fig. 1 3A, the color change vectors of the above 
pixels are approximate to each other. 

40 [0113] When priority is given to prevention of false 
color generation, a method of calculating a color change 
vector from the pixel of interest to the selected pixel first, 
and setting an intersection between this color change 
vector and the threshold value Thy2 of the Y component 

45 as a new value of the pixel of interest may be used, as 
shown in Fig. 13B. More specifically, Fig. 13B shows an 
example, when priority is given to the vector direction 
over the vector strength. That is, if the vector directions 
of colors agree with each other, no conspicuous false 

50 color is generated. The intersection can be calculated 
by linear interpolation between the two colors of the pixel 
of Interest and selected pixel. 

[0114] That Is, various approximate color generation 
means may be proposed depending on methods of gen- 
55 erating a color approximate to that of the selected pixel 
while satisfying a change allowable amount condition 
between two points of the pixel of interest and selected 
pixel. In Fig. 13A, such generation means is implement- 



11 



21 



EP 1 377 030 A2 



22 



ed by clipping only one component of a color. In Rg. 
13B, the generation means Is Implemented by linearly 
changing other components in conjunction with clipping 
of one component. 

[0115] As described above, this embodiment is char- 
acterized in that when the pixel of interest cannot be 
substituted by a probabilistically selected pixel since the 
allowable amount condition Is exceeded, an approxi- 
mate color which Is approximate to the color of the se- 
lected pixel is generated, and is detemnined as a new 
value of the pixel of interest. Note that Figs. 13A and 
13B show two example of the approximate color gener- 
ation methods. However, the present Invention is not 
limited to such specific methods. 

<Thlrd Embodiment> 

[0116] Fig. 14 is a flow chart for explaining the oper- 
ation sequence of a noise removal module according to 
the third embodiment of the present invention. Note that 
Fig. 14 shows another example of the operation se- 
quence of the noise removal module 1 01 shown In Fig. 
2. 

[01 17] As shown In Fig. 1 4, the noise removal module 
Is initialized to reset variable i Indicating a vertical 
processing address to zero (step SI 401 ). Likewise, var- 
iable J indicating a horizontal processing address is reset 
to zero (step S1402). Also, a loop count is initialized to 
reset variable loop indicating a selectable loop count per 
pixel of interest (step SI 403). 

[01 1 8] The random number generator 205 generates 
a random number (step SI 404). The pixel selector 204 
determines the values of horizontal and vertical relative 
positions a and b from the pixel of interest on the basis 
of the generated random number (step SI 405). Using 
the determine values a and b, comparison is made (step 
S1406) to see whether or not: 

llr(i. j) - lr{i+a. j+b)l < Thr 

and 

llg(i, j) - lg(i+a. j+b)I <Thg 

and 

llb(i. j) - lb(i+a, j+b)l <Thb 

where Ir (i, j ) is the pixel value of the R component of 
the pixel of interest located at a coordinate position (i, 
J). Ig(i. J) is the pixel value of the G component, and lb(i, 
j) is the pixel value of the B component. Also. Thr, Thg, 

and Thb are respectively predetermined R, G, and B 
threshold values. Furthermore, Ixi is the absolute value 
of X. 



[0119] If the comparison result in step S1406 is Yes, 
the selected pixel values are substituted in new values 
of the pixel of interest (step SI 407). Assume that Fr, Fg, 
and Fb represent new R, G, and 6 component values 

5 of the pixel of interest. 

[0120] On the other hand, if the comparison result in 
step 81406 is No. loop count variable loop is counted 
up by 1 (step S1408). It is checked If loop count variable 
loop Is smaller than a predetemnined value (Thioop) 

10 (step SI 409). As a result, if variable loop is smaller than 
the predetemnined value (Yes in step S1409). the afore- 
mentioned processes are repeated from the random 
number generation step in step SI 404. On the other 
hand, if variable loop Is equal to the predetemnined value 

IS (No in step SI 409), the old values of the pixel of Interest 
are used as new values, and no substitution is made 
(step S1410). 

[0121] In this embodiment, the number of substituted 
pixels can be increased using repetition. That is, when 

20 a steep edge and impulse noise having an isolated value 
are present together with low-frequency noise within the 
window, the value of the selected pixel Is often largely 
different from that of the pixel of interest. With the oper- 
ation sequence shown in the flow chart of Fig. 3, the 

25 selected pixel Is determined by generating a random 
number once per pixel of interest. However, in this em- 
bodiment, since a pixel value within an allowable range 
is more likely to be selected by repeating the processes 
a plurality of number of times, low-frequency noise can 

30 be removed more satisfactorily. 

< Fourth Embodiment> 

[0122] Fig. 15 is a flow chart for explaining the oper- 
as ation sequence of a noise removal module according to 
the fourth embodiment of the present invention. Note 
that Fig. 15 shows stilt another example of the operation 
sequence of the noise removal module 101 shown in 
Fig. 2. 

40 [0123] As shown in Fig. 15, the noise removal module 

is initialized to reset variable i indicating a vertical 
processing address to zero (step SI 501). Likewise, var- 
iable j indicating a horizontal processing address is reset 
to zero (step SI 502). The random number generator 

45 205 generates a random number (step S 1 503). The pix- 
el selector 204 determines the values of horizontal and 
vertical relative positions a and b from the pixel of inter- 
est on the basis of the generated random number (step 
SI 504). Using the detemnine values a and b, compari- 

50 son is made (step SI 605) to see whether or not: 

llr(l, j) - lr(i+a, j+b)l <Thr 

55 and 

fg(i.J) - lg(i+a, j+b)l <Thg 
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and 

llb(i.j)-lb(i+a, j+b)l <Thb 

where Ir (i. j) is the pixel value of the R component of 
the pixel of interest located at a coordinate position (i, 
J)i lg((i J) is the pixel value of the G component, and ib(i, 
J) is the pixel value of the B component. Also, Thr, Thg, 
and Thb are respectively predetermined R, G, and B 
threshold values. Furthermore. Ixl Is the absolute value 
of x. 

[0124] If the comparison result in step S1505 is Yes, 
new values of the pixel of interest are calculated (step 
SI 506) by: 

Fr(i. j) = A X lr(i, j) + (1 - A) x lr(i+a, j+b) 



FgO. j) = A X lg(i, j) + (1 - A) X lg(i+a. j+b) 



Fb(l, j) = A X lb(i, j) + (1 - A) X lb(l+a, j+b) (3) 

where A is a predetermined coefficient. 
[0125] On the other hand, if the comparison result in 
step S1505 is No, the old values of the pixel of interest 
are used as new values and no substitution is made 
(step S1507). That is, in this embodiment, the calcula- 
tion results of the product sum calculations are used as 
the new values of the pixel of interest in place of substi- 
tution of the values of the selected pixel. 
[0126] A conventional LPF is used to calculate the 
weighted mean of neighboring pixels to have the pixel 
of interest as the center. Also, the LPF is used to cut off 
a high-frequency region by a filtering process using 
weighting coefficients depending on spatial distances 
between the pixel of Interest and neighboring pixels. 
[0127] On the other hand, a concern of the present 
invention is not to cut off the high-frequency region but 
to remove low-frequency noise by converting some 
components of the low-frequency strength into the white 
noise strength. In the processing operation shown in the 
flow chart of Fig. 3 above, surrounding pixels are prob- 
abilistically selected and substituted irrespective of cor- 
relation values with the pixel of interest, thereby break- 
ing the correlations with neighboring characteristics. 
However, if many selected pixels have values equal to 
or higher than the threshold value as an allowable 
amount, the ratio of pixels to be substituted decreases, 
and the effect is reduced. 

[0128] Hence, this embodiment has as a concern to 
increase the ratio of conversion of the values of the pixel 
of interest by adopting the product sum calculation re- 
sults of the selected pixel and the pixel of interest as 
converted values in place of substituting the selected 
pixel. That is, a noise removal module 101 according to 



the present invention Is characterized by comprising a 
window unit 203 for designating a region made up of a 
pixel of interest and its surrounding pixels of Image data 
which contains low-frequency noise, a pixel selector 204 

5 for selecting a selected pixel to be compared with the 
pixel of interest from the region, and a pixel value deter- 
mination unit 206 for determining a new pixel value of 
the pixel of interest by a product sum calculation of pixel 
values of the selected pixel and the pixel of interest. 

10 [0129] For example, when a maximum allowable 
change amount of the pixel of interest is specified, if the 
value of coefficient A of equations (3) is set to A = 1/2, 
the comparison threshold value of the product sum cal- 
culations becomes twice as large as the maximum ai- 

is lowable change amount. Therefore, the probability of 
conversion of the pixel of interest obviously Increases. 
[01 30] Fig. 1 3B above corresponds to a case wherein 
the value of coefficient A in equations (3) is dynamically 
varied in correspondence with the difference between 

20 the pixel of interest and selected pixel, although color 
components are different. That is. Fig. 1 38 corresponds 
to a case wherein A = 0 Is equivalently set until a pre- 
detennined difference value, and when the difference 
becomes equal to or larger than the predetermined dif- 

2S ference value, the value of coefficient A Increases mo- 
notonously. 

[0131] When the value of coefficient A in equations 
(3) is set to meet 0 < A < 1 (A = 0 is equivalent to sub- 
stitution), such case corresponds to spatially linear in- 

30 terpolation between the pixel of interest and selected 
pixel. More specifically, the pixel value detemiination 
unit 206 is characterized by determining a new pixel val- 
ue by interpolation between the selected pixel and pixel 
of Interest. Conversely, when the value of coefficient A 

35 in equations (3) is set to a negative value, such case 
corresponds to spatially linear extrapolation between 
the pixel of interest and selected pixel. That is, the pixel 
value determination unit 206 is characterized by deter- 
mining a new pixel value by extrapolation between the 

40 selected pixel and pixel of interest. 

[0132] Fig. 16 shows the concept of extrapolation 
made in this embodiment. As shown in Fig. 16, assume 
that the window size is 5 x 5 pixels, and the position of 
central portion P is the pixel of interest. Also, assume 

^5 that a pixel at point Q in the window is probabilistically 
selected using a random number. 
[0133] If the value of coefficient A in equations (3) is 
set to -1 , calculations given by equations (3) correspond 
to linear extrapolation, i.e., to calculation of the extrap- 

50 olated value of extrapolation point R outside the window. 
That is, when the extrapolated value corresponding to 
the pixel position outside the window is used as the con- 
verted value, an effect close to that obtained by a sub- 
stitution process by setting a large window size can be 

S5 obtained. Note that the window size is determined by 
the number of line buffers, and is imposed large soft- 
ware and hardware limitations. Hence, it is preferable to 
obtain a larger effect using a smaller window size. 
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[0134] As described above, according to this embod- 
iment, by optimizing the coefficient of the product sum 
calculations, when Interpolation Is used, an effect of In- 
creasing the ratio of conversion of the pixel of interest 
can be obtained; when extrapolation is used, an effect 5 
similar to that obtained using a larger window size can 
be obtained. Furthermore, the above interpolation and 
extrapolation are implemented by linear calculations, 
but may be implemented by nonlinear calculations In ac- 
cordance with the difference between the pixel values io 
of the pixel of interest and selected pixel. That Is, the 
present invention is characterized in that a weighting co- 
efficient in a product sum calculation is set based on the 
difference between the pixel values of the selected pixel 
and pixel of interest. 

[0135] As for coefficient A In equations (3), the same 
coefficient values are used for three, R, G. and B com- 
ponents. Alternatively, different coefficients may be 
used for respective color components. Furthermore, in 
this embodiment, the number of pixels to be selected is 20 
one pixel, but a plurality of pixels may be selected. When 
a plurality of pixels are selected, random numbers cor- 
responding in number to the selected pixels are prefer- 
ably generated. 

[0136] That is. the present invention Is characterized 25 
in that different weighting coefficients in the product sum 
calculation are used in correspondence with a plurality 
of color components. The noise removal module 101 ac- 
cording to the present Invention is characterized in that 
the pixel value determination unit 206 compares, for 30 
each of the plurality of color components, if the differ- 
ence is equal to or smaller than a predetermined value. 
Furthermore, the noise removal module 101 is charac- 
terized in that the pixel selector 204 can select a plurality 
of pixels from a window, and the pixel value determina- 35 
tion unit 206 determines the new pixel value of the pixel 
of interest using the plurality of selected pixels. 
[0137] Since the effect of the present invention is re- 
duced if the value of A as the weighting coefficient for 
the pixel of Interest becomes large, If the number of se- ^0 
looted pixels is n (n ^ 1), it is preferable that the contri- 
bution ratio of the value of the pixel of interest to the 
converted value is equal to or lower than 1/(n + 1). In 
addition, a plurality of pixels may be selected, and the 
new value of the pixel of interest may be determined by 
only the product sum calculations among the selected 
pixels without using the pixel of interest. 

<Fifth Embodiment> 

50 

[0138] Fig. 1 7 is a flow chart for explaining the oper- 
ation sequence of a noise removal module according to 
the fifth embodiment of the present Invention. Note that 
Fig. 1 7 shows still another example of the operation se- 
quence of the noise removal module 1 01 shown in Fig. ss 
2. 

[0139] Since only some steps in Fig. 17 are different 
from those in the operation sequence of the flow chart 



shown in Fig. 3, only differences will be explained below. 
Fig. 1 7 Is characterized in that the probability distribution 
correction step as step SI 71 2 Is inserted after the uni- 
form random number generation step as step 81703. 
That is. the probability distribution correction process in 
step 81 71 2 corrects a uniform probability distribution af- 
ter the random number Is generated to a desired prob- 
ability distribution. This probability distribution correc- 
tion process Is characterized in that a probability upon 
selecting a pixel is varied depending on the spatial dis- 
tance from the position of the pixel of interest. 
[0140] Figs. 1 8A and 1 8B are views for explaining an 
outline of probability distribution correction executed In 
step 81 71 2. Figs. 18Aand 188 show a linear generation 
probability distribution for the sake of simplicity, in both 
Figs. 1 8A and 1 88, the abscissa plots the inter-pixel dis- 
tance between the pixel of interest and selected pixel, 
and the ordinate plots the probability distribution. As- 
suming that the window size In a one-dimensional direc- 
tion is (2d+1) pixels, a remainder calculation is made so 
that the generated random number assumes a value 
falling within the range from -d (inclusive} to d (Inclu- 
sive). Note that Fig. 1 8A shows a state wherein the gen- 
eration probability within the range from -d (inclusive) to 
d (Inclusive) Is uniform. Fig. 188 shows a state wherein 
the generation probability Increases with increasing ab- 
solute value of d. This indicates that a pixel is selected 
more easily with increasing spatial distance from the po- 
sition of the pixel of interest. 

[0141] That is. the pixel selector 204 of the noise re- 
moval module 101 according to the present invention is 
characterized by using a random number generated 
based on a generation probability distribution which de- 
pends on the distance from the pixel of interest. Also, 
the present invention is characterized in that this gener- 
ation probability distribution has a higher generation 
probability with increasing distance from the pixel of in- 
terest. 

[0142] When the probability upon selecting a pixel 
changes depending on the distance from the pixel of in- 
terest, correlations between the pixel of interest and se- 
lected pixel can be controlled. That is, assuming that the 
autocorrelation function changes in correspondence 
with the distance from the pixel of interest, as shown in 
Fig. 4, flexible setups that increase/decrease the gen- 
eration probability in correspondence with desired cor- 
relations to be selected can be implemented. Note that 
the generation probability is preferably set by experi- 
ments. Fig. 18B exemplifies a case wherein the proba- 
bility distribution linearly changes with respect to the dis- 
tance from the pixel of interest. Of course, the probability 
distribution may change nonlineariy. 
[01 43] The method of determining a new value of the 
pixel of interest on the basis of a probabilistically select- 
ed pixel and the pixel of interest has been explained. In 
this method, either one or a plurality of pixels may be 
selected. In the above example, substitution or conver- 
sion is switched by evaluating the absolute value of the 
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difference between the selected pixel and pixel of inter- 
est. However, the present invention is not limited to such 
specific evaluation. 

[0144] The present invention has exemplified a case 
wherein a selected pixel Is probabilistically determined 
from surrounding pixels using a generated random 
number. Attematively. the pixel position to be selected 
may be controlled by specifying a predetennined regu- 
larity In place of generating a random number. That is. 
it is not preferable to always select a pixel at a fixed rel- 
ative position from the position of the pixel of Interest In 
terms of image quality. Hence, a method of specifying a 
regularity that varies the relative position by predeter- 
mined coordinate positions every time the pixel of inter- 
est scans one pixel, and detemnining a selected pixel In 
turn based on the variation regularity is effective. The 
predetermined coordinate positions in the variation reg- 
ularity may have a fixed variation amount (e.g., n pixels 
in the horizontal direction, and m pixels in the vertical 
direction), or the variation amount itself may be a non- 
linear variation amount which is variable for respective 
pixels. 

[0145] In place of specifying the regularity of the var- 
iation amount, the relative position may be determined 
based on a regularity function of an absolute coordinate 
position (i, j) of the pixel of interest. The regularity func- 
tion may be stored in a table or may be detemiined by 
calculations. 

[01 46] The present invention is directed to a noise re- 
moval module which reduces visual noise components 
contained in the low-frequency range of image data. 
[0147] Correlations between a pixel of interest and 
surrounding pixels in the image data may be reduced to 
control decreased signal strengths of low-frequency 
components upon reducing the correlations and to con- 
vert the decreased signal strengths to white noise. 
[0148] Furthermore, the present invention is directed 
to a noise removal module which visually reduces noise 
components contained in the low-frequency range of im- 
age data, and in which conrelations between a pixel of 
interest and surrounding pixels in the image data are 
reduced to control decreased signal strengths of low- 
frequency components upon reducing the correlations, 
to convert the decreased signal strengths to broad-band 
noise, and to control the band width of broad-band noise 
conversion means. 

[0149] The present invention can also be carried out 
by supplying a storage medium (or recording medium) , 
which records a program code of software that can im- 
plement the functions of the above-mentioned embodi- 
ments to a system or apparatus, and reading out and 
executing the program code stored in the storage me- 
dium by a computer (or a CPU or MPU) of the system 
or apparatus. 

[0150] In this case, the program code itself read out 
from the storage medium implements the functions of 
the above-mentioned embodiments, and the storage 
medium which stores the program code constitutes the 



present invention. The functions of the above-men- 
tioned embodiments may be Implemented not only by 
executing the readout program code by the computer 

but also by some or all of actual processing operations 
5 executed by an operating system (OS) or the like run- 
ning on the computer on the basis of an instnjction of 
the program code. 

[0151] Furthermore, the functions of the above-men- 
tioned embodiments may be Implemented by some or 

10 all of actual processing operations executed by a CPU 
or the like arranged In a function extension card or a 
function extension unit, which is inserted in orconnected 
to the computer, after the program code read out from 
the storage medium is written in a memory of the exten- 

is slon card or unit. 

[0152] As described above, according to the present 
Invention, by determining a new value of a pixel of Inter- 
est on the basis of the pixel of interest, and a pixel which 
is probabilistically selected from those around the pixel 

20 of interest, low-frequency noise contained in Image data 
can be visually removed by converting the generated 
low-frequency noise strength Into the white noise 
strength. 

[01 53] Since the band width of noise and the strength 

25 of noise after conversion can be controlled, It Is easy to 
adjust the image quality by noise removal. Since a pixel 
value substitution process and approximate color con- 
version process allow conversion free from generation 
of conspicuous false colors, satisfactory noise removal 

30 can be executed even for a color image. Furthemnore, 
since a high-image quality noise removal process can 
be implemented by a simple arrangement, a system ar- 
rangement that outputs an image sensed by a digital 
camera to a printer can provide a high-quality digital 

35 print that suffers less noise. 

[0154] The present invention Is not limited to the 
above embodiments and various changes and modifi- 
cations can be made within the spirit and scope of the 
present inventions. Therefore, to apprise the public of 

40 the scope of the present Invention, the following claims 
. are made. 



Claims 

45 

1 . An image processing apparatus characterized by 

comprising: 

input means for inputting image data containing 

50 low-frequency noise; 

designation means for designating a region 
made up of a predetemnined pixel and sur- 
rounding pixels of the predetermined pixel in 
the image data; 

55 selection means for selecting a comparison pix- 

el to be compared with the predetermined pixel 
from the region; 

determination means for detemnining anew pix- 
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el value of the predetermined pixel on the basis 
of pixel values of the comparison pixel and the 
predetermined pixel; and 
substitution means for generating new image 
data by substituting the pixel value of the pre- 5 
detenmined pixel by the new pixel value. 

2. The apparatus according to claim 1 , characterized 
in that said selection means selects the compari- 
son pixel from the region using a random number io 

3. The apparatus according to claim 2, characterized 
in that said selection means uses the random 
number, which is generated on the basis of a uni- 
form probability distribution. is 

4. The apparatus according to claim 2, characterized 
in that said selection means uses the random 
number, which is generated on the basis of a gen- 
eration probability distribution depending on a dis- 
tance from the predetermined pixel. 

5. The apparatus according to claim 4, characterized 
in that the generation probability distnlautlon has a 
higher generation probability with increasing dis- 2S 
tance from the predetermined pixel. 

6. The apparatus according to claim 1 , characterized 
in that said selection means selects the compari- 
son pixel from the region on the basis of a prede- so 
termined regularity. 

7. The apparatus according to claim 6, characterized 
in that the predetermined regularity varies a rela- 
tive position from the predetermined pixel for each 35 
predetemnined pixel. 

8. The apparatus according to claim 6, characterized 
in that the predetermined regularity detemntnes a 
relative position from the predetennined pixel on the 40 
basis of an absolute coordinate position of the pre- 
determined pixel. 

9. The apparatus according to claim 1 , characterized 
in that said determination means detemnines the 
new pixel value of the predetennined pixel on the 
basis of a difference between the pixel values of the 
comparison pixel and the predetermined pixel. 

10. The apparatus according to claim 9, characterized so 
in that said determination means determines the 
pixel value of the comparison pixel as the new pixel 
value of the predetermined pixel when the differ- 
ence is not more than a predetermined value. 

55 

1 1 . The apparatus according to claim 1 , characterized 
in that said determination means determines a val- 
ue obtained by adding or subtracting a predeter- 



mined value to or from the pixel value of the prede- 
termined pixel as the new pixel value of the prede- 
termined pixel. 

12. The apparatus according to claim 1 . characterized 
by further comprising: 

approximate color generation means for gener- 
ating an approximate color which is approxi- 
mate to the pixel value of the comparison pixel, 
and 

in that said determination means uses the ap- 
proximate color as the new pixel value of the 
predetermined pixel. 

13. The apparatus according to claim 12, character- 
ized in that said approximate color generation 
means generates an approximate color, which is 
approximate to at least one of a plurality of color 
components within a predetennined range. 

14. The apparatus according to claim 13, character- 
ized in that said determination means detemnines 
new pixel values of the predetermined pixel using 
the approximate color which Is generated by ap- 
proximation within the predetennined range for at 
least one of a plurality of color components, and us- 
ing pixel values of the comparison pixel for the re- 
maining color components. 

15. The apparatus according to claim 12, character- 
ized in that said determination means has two 
threshold values, 

said determination means determines the pix- 
el value of the predetermined pixel as the new pixel 
value when the difference is smaller than a first 
threshold value, and 

said detemnination means determines the ap- 
proximate color as the pixel value of the predeter- 
mined pixel when the difference for at least one of 
a plurality of color components is not less than the 
first threshold value and is smaller than a second 
threshold value. 

16. An image processing apparatus characterized by 

comprising: 

Input means for inputting image data containing 

low-frequency noise; 

designation means for designating a region 
made up of a predetennined pixel and sur- 
rounding pixels of the predetermined pixel in 
the image data; 

selection means for selecting a comparison pix- 
el to be compared with the predetermined pixel 
from the region; and 

determination means for determining a new 
pixel value of the predetermined pixel by a 
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product sum calculation of pixel values of the 
comparison pixel and the predetemiined pixel. 

17. The apparatus according to claim 16, character- 
ized in that said detemnination means determines s 
the new pixel value of the predetermined pixel by 
interpolation of the comparison pixel and the prede- 
termined pixel. 

18. The apparatus according to claim 16, character- io 

Ized in that said detennlnation means determines 
the new pixel value of the predetemnined pixel by 
extrapolation of the comparison pixel and the pre- 
detemnined pixel. 

15 

19. The apparatus according to claim 16, character- 
ized In that a weighting coefficient In the product 
sum calculation is set on the basis of a difference 
between the pixel values of the comparison pixel 
and the predetermined pixel. 20 

20. The apparatus according to claim 19, character- 
ized In that the product sum calculation uses dif- 
ferent weighting coefficients in correspondence 
with a plurality of color components. 25 

21 . The apparatus according to claim 1 , characterized 
in that said detemnination means compares if dif- 
ferences for ail of a plurality of color components 

are not more than a predetemiined value. 30 

22. The apparatus according to claim 1 , characterized 
in that said selection means can select a plurality 
of comparison pixels from the region, and 

said determination means determines the 35 
new pixel value of the predetermined pixel using the 
plurality of selected comparison pixels. 

23. The apparatus according to claim 1 , characterized 

by further comprising pseudo halftone means for 40 
executing a pseudo halftone process of the gener- 
ated new image data using error diffusion. 

24. An image processing apparatus for visually reduc- 
ing noise components contained in a low-frequency 
range of image data, characterized by comprising: 

correlation reduction means for reducing conge- 
lations between a predetermined pixel and sur- 
rounding pixels of the predetermined pixel in so 
the image data; 

signal strength control means for controlling de- 
creased signal strengths of low-frequency com- 
ponents upon reducing the correlations; and 
white noise conversion means for converting 55 
the decreased signal strengths into white noise 
components. 



25. An image processing apparatus for visually reduc- 
ing noise components contained in a tow-frequency 
range of image data, characterized by comprising: 

correlation reduction means for reducing con-e- 
lations between a predetermined pixel and sur- 
rounding pixels of the predetermined pixel in 
the image data; 

signal strength control means for controlling de- 
creased signal strengths of low-f req uency com- 
ponents upon reducing the correlations; 
broad-band noise conversion means for con- 
verting the decreased signal strengths into 
broad-band noise components; and 
bandwidth control means for controlling a band 
width of said broad-band noise conversion 
means. 

26. An image processing method characterized by 
comprising: 

a designation step of designating a region 
made up of a predetermined pixel and sur- 
rounding pixels of the predetermined pixel in 
image data containing low-frequency noise; 
a selection step of selecting a comparison pixel 
to be compared with the predetemiined pixel 
from the region; 

a determination step of detemriining a new pixel 
value of the predetermined pixel on the basis 
of pixel values of the comparison pixel and the 
predetermined pixel; and 
a substitution step of generating new image da- 
ta by substituting the pixel value of the prede- 
termined pixel by the new pixel value. 

27. An image processing method characterized by 
comprising: 

a designation step of designating a region 
made up of a predetemiined pixel and sur- 
rounding pixels of the predetermined pixel in 
image data containing low-frequency noise; 
a selection step of selecting a comparison pixel 
to be compared with the predetermined pixel 
from the region; and 

a determination step of detemriining a new pixel 
value of the predetermined pixel by a product 

sum calculation of pixel values of the compari- 
son pixel and the predetemiined pixel. 

28. An image processing method for visually reducing 
noise components contained in a low-frequency 
range of image data, characterized by comprising: 

a correlation reduction step of reducing corre- 
lations between a predetermined pixel and sur- 
rounding pixels of the predetermined pixel in 
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the image data; 

a signal strength control step of controlling de- 
creased signal strengths of low-frequency com- 
ponents upon reducing the correlations; and 
a white noise conversion step of converting the 5 
decreased signal strengths into white noise 
components. 

29. An image processing method for visually reducing 
noise components contained In a low-frequency io 
range of Image data, characterized by comprising: 

a correlation reduction step of reducing corre- 
lations between a predetermined pixel and sur- 
rounding pixels of the predetermined pixel in is 
the Image data; 

a signal strength control step of controlling de- 
creased signal strengths of low-frequency com- 
ponents upon reducing the correlations; 
a broad-band noise conversion step of convert- 20 
ing the decreased signal strengths into broad- 
band noise components; and 
a band width control step of controlling a band- 
width of the broad-band noise conversion step. 

25 

30. A computer program for removing noise compo- 
nents from image data containing low-frequency 
noise, said program maldng a computer execute: 

a designation step of designating a region 30 
made up of a predetermined pixel and sur- 
rounding pixels of the predetermined pixel In 
the image data; 

a selection step of selecting a comparison pixel 

to be compared with the predetermined pixel 35 

from the region; 

a determination step of determining a new pixel 
value of the predetermined pixel on the basis 
of pixel values of the comparison pixel and the 
predetenmined pixel; and 40 
a substitution step of generating new image da- 
ta by substituting the pixel value of the prede- 
termined pixel by the new pixel value. 

31. A computer program for removing noise compo- 45 
nents from image data containing low-frequency 
noise, said program making a computer execute: 



son pixel and the predetermined pixel. 

32. A computer program for visually reducing noise 
components contained in a low-frequency range of 
image data, said program making a computer exe- 
cute: 

a correlation reduction step of reducing corre- 
lations between a predetenmined pixel and sur- 
rounding pixels of the predetermined pixel In 
the image data; 

a signal strength control step of controlling de- 
creased signal strengths of low-frequency com- 
ponents upon reducing the correlations; and 
a white noise conversion step of converting the 
decreased signal strengths Into white noise 
components. 

33. A computer program for visually reducing noise 
components contained in a low-frequency range of 
image data, said program making a computer exe- 
cute: 

a correlation reduction step of reducing corre- 
lations between a predetemnined pixel and sur- 
rounding pixels of the predetermined pixel in 
the image data; 

a signal strength control step of controlling de- 
creased signal strengths of low-frequency com- 
ponents upon reducing the correlations; 
a broad-band noise conversion step of convert- 
ing the decreased signal strengths into broad- 
band noise components; and 
a band width control step of controlling a band 
width of the broad-band noise conversion step. 

34. A recording medium characterized by storing a 
computer program of claim 30. 
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a designation step of designating a region 
made up of a predetermined pixel and sur- so 
rounding pixels of the predetermined pixel in 
the Image data; 

a selection step of selecting a comparison pixel 
to be compared with the predetenmined pixel 
from the region; and 55 
a determination step of determining a new pixel 

value of the predetennined pixel by a product 
sum calculation of pixel values of the compari- 
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